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A teacher training program was implemented over a 
2-year period in cooperation with the Tucson Unified School District, 
where over 28% of the students have been identified as having a 
primary language other than English. The goal of the training was to 
provide a forum wherein teachers and administrators .would explore the 
application of ethnographic/sociolinguistic theories and 
methodologies as these can be applied to language proficiency 
assessment practices. The training was implemented in three phases. 
Phase I was a graduate level course for participating teachers wjiich 
focused on models of language proficiency, and language proficiency 
in the bilingual classroom and community. Phase II consisted of the 
development of field techniques and a teacher observation instrument 
(TOS). Central to this instrument is a consideration of the social 
contexts used to describe students* language behavior. Phase III 
consisted of several stages: identification of. issues for field, 
testing of the TOS, more formal training for teachers in 
microethnographic/sociolinguistic field methods, and development of 
criteria for analyzing TOS field test results. Finally, the 
limitations and significance of the teacher traiaiiig~pxogiiaiiL^££L 



described in order to provide evaluative information regarding the 
ethnographic/sociolinguistic approach to language proficiency 
assessment. (AMH) 
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Introduction 

The research reported in this paper was implemented under the Assessment 
of Language Proficiency of 3i1ingual Persons (ALPBP) project. •The two-year 
project is funded by the National Institute of Education (NIE) and adminis- 
tered by InterAmerica Research Associates. , 

The purpose of this paper is to describe the teacher training program 
implemented over a 'two year period'in cooperation with Tucson Unified School 
Oistric* (TUSD) . TJJSD was selected as the training site for the ALPBP project 
because oTVhte^d i str i ct 1 s interest in the development of innovative approaches 
to the education oK language minority students. TUSD serves a community in 
excess of 500,000. ^proximately 57,000 students are enrol l^d^Ljj^ TUSD schools. 
Approximately 16,00)6, or 2 8 M% , are * i span i c, of which aRoroximately 11,000 have 
been identified as having a primary language other than English. In additi/fn, 
the school district also services about 1,000 student^ from'79 various language 
backgrounds; 

TUSD" administrators felt that the ALPBP teacher training program in 
e chno graph ic /so ciqj [ ngu j^xic_„ met hodo 1 Q£j would _-Comp l.&meru^- their . ef-fo-rts— In — - 



developing a nontrad i t ional language prof iciency assessment instrument, the 
Language Proficiency Measure (U^^USD, 1981). The educators who became 
involved in the training program were teachers and 'admin is trators from the 
school district. 0 i st r i c t admin i s tra tor s had an opportunity to input in the 
content of the program du cing the planning stage through, a variety of phone 
conversations and on-site meetings. Teachers had an ooportunity to contri- 
bute to the training clan through a needs assessment survey and formal and 
informal meetings. v 1 



The general goa Y of the training component of the ALPSP project was to 
provided forum whereiif teachers and administrators would explore the application 
of ethnographi c/soc iol i rrgu i st i c theories and methodologies applied to language 
proficiency assessment practices. In ordei^to accomplish thi§ goal, bilingual 
and monolingual educators were provided with a background in linguistics, 
sociolinguist ics , ethnography of speaking, measurement, and research methodology 
The expectpd outcome of the training was that it would enable Tucson educators 
to develop more effective language proficiency assessment strategies applicable 
to their particular student population. 

The'process of establishing a relationship with TUSD administrators and 
teachers took placfc over approx-ima te 1 y a six month'per i,od in the fall and 
winter of 1979- The actual training was implemented in three phases. Phase 
I consisted of a graduate level course, offered during the spring semester of 
1980. Phase II was implemented in the form of a three week intensive work- 
shop in the summer. of I98O. During th i sfworkshrop , the Teacher Observation 
Instrument ( TPS ) was developed. Phase IK., the last of the ALP8P training 
component implemented in Tucson, consisted of* several stages. The first 
carrrtitutecTa preparatron stage wherein the ALPBP project staff identified 
sal ient issues to be considered for the field testing of the TPS . Following 
Che preparation stage, a workshop was implemented in the spring of I98I to 
give teachers more formal training i n *rni c roe thnograph i c/soc i o l i ngu i s t i c field 
methods. This was undertaken with the specific purpose of enabling TUSD 
teachers to field test the TPS . The next stage consisted of the development 
of criteria for* ana l yz i ng the TPS fi^ld test ' resul ts . The\f i na I i zat ion, of 
th is process took place in. a two-day meeting in the summer of 1 98 1 with a 
TUSD representative, the ALP8P Project Director, and ALP8P Research Associate. 



A detailed description of Phase lyls found in Philips' article in this mono- 
graph. The actual training process and outcomes from Phases II and III are 
fully described in the body of the paper. The* cone 1 i^orTfpcuses on evaluative 
information identifying 1 imi tat iofLs and significance of the ALP8P teacher 
training program in Tucson. , ' 

Theoretical and 4 Hethodologi ca 1 Approach 

Traditionally, schools have u&ed a developmental model of acquisition of 

communicative skills based on white middle-class children's socialization 

experiences. This model assumes children come to school having the same 

basic experiences at home ^nd in the community. It also assufoes* that cognitive 

and linguistic skill devel opment * fol 1 ows a rather fixed growth curve which 

takes as the norm ^biite middle-class chi^lren's developmenta 1 characteristics. 

These assumptions are reflected in. standard monolingual curriculum objectives 

as well as in the segmentation of knowledge by grade level. The model fails 

to recognize culturally different language soc i al i za t ion' exper i ences of 

children f rom mul t i 1 ing^ual /mul t i cu 1 tural backgrounds. It lacks the necessary 

flexibility to build upon variability in the acquisiti6n of communicative 

skills, by children of*d i f ferment cultural backgrounds, and to relate these 

skM'ls ,to the learning of nevJ^concepts at school. This lack of understanding 

and acceptance of culturally different language socialization patterns of 

communication may be a major factor contributing to the poor performance in 

"school by language-minority students^(Phi 1 i ps , Note l). 

»* * 
Recogni z ing the inadequacies of this traditional model, an ethnographic/ 

soc iol ingui st ic approach to communicative proficiency and its assessment was 



adopted for use m the ALPBP teacher training program. The approach entails 

both theoretical and methodological considerations about the nature of children 1 

... / 
language acquisition, language use, and its measurement. 

From a theoretical perspective, the concept of language proficiency is 
seen as embracing "the child's full range of social uses of language and ^on- 
verbal signals rather than encompassing uses associated with the transmission 
"of 1 i teracy skills of reading and wri ti ng )} (Phi I i ps, in press , <p. 3) . 

Mn order to operat iona 1 ize this interpretation of the 1 anguage 'construct , 
Briere's ( 1979) Jn tegrat i ve model of communicative proficiency was modified for 
^use in the training process to include those factors which influence children's 
language development and language use. The model, illustrated in Figure lv 
consists of four basic components: linguistic competence and linguistic per- 
formance — based on Chomsky's (1965) understanding of language — and socio- 
linguistic competence and sociol ingu ist ic performance : - based on Hymes (1972) 

4 

interpretation of communicative competence. 



Figure I. /V SOC I0L INGU1 STIC/L INGU I STIC MODEL OF COMMUNICATIVE PROFICIENCY 

(Adapted from Briere, 1979) 
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Linguistic competence refers to the intuitive knowledge a native speaker 

has about the rules of the grammar of his/her language(s) (i.e*, phonology, 

syntax, and the lexicon). This refers, for example, to the tacit knowledge a 

native English-speaking student has about when and how to use ffoth regular and 

S, 

irregular plurals, to make verb and noun agreements, or to understand the 
sounds of the dialectal variations spoken in various communities. 

Linguistic performance refers to the actual use the speaker makes of 
his/her linguistic competence using the n proper M grammar and vocabulary. 
These skills are evidenced in the ability to comprehend and -Speak as well as 
to read and write if literacy skills have been introduced. 

Sociol inguistic competence refers to the knowledge a*natiye speaker has 
about the appropriate 'use of his/her language within different social environ- 
ments, i.e., the taci t knowledge of what to say to whom, for what reason(s) 
and under what c i rcums tance (s) . In the school setting, it refer§ to the 
knowledge a student has of the appropriate rules of interaction and interpre- 
tation when interact ing ^wi th teachers, peers and otjier participants. 

Soc iol inguistic perfornQfc g-^e f ers to the actual communicative behaviors 
of a speaker which lead other member's GT Js a~ speech community to believe that 
he/she I s commun icat ing appropriately. For example, in U.S. schools teachers 
often expect students to look'Shem in the eye while being reprimanded or -when 
responding'. In some cultures this is considered inappropriate; thus, if a 
student does nof provide a response appropriate to the culture, *a teacher 
unfami 1 i ar with the child's cultural background might conclude that the student 
is disrespectful or uncooperative. 



/ 
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The ethnographic perspective requires the application of methodologies 
which support observation of naturally occurring i qteractj^risy pactjci pant 
_ observations and-4^terv iews as research tools for determining the nature of 
children's communicative proficiency. This' is in contrast to experimental 
methodologies which focus on language interactions in contrived rather .than 
natural settings. By their very nature, experimental methodologies disregard 
children's natural language abilities because they fibcus on knowledge of 
language skills which may lie outside their socialization experiences-. 



In an effort to develop observational criteria to, be used in analyzing 
observations of children's naturally occur r i ng commun i cat i ve interactions and 
relate these to communicative proficiency, ALP8P project staff reviewed 
current theoretical and applied research on the nature of language arvd its 
functional uses. Following is a brief summary from that review, 

V 

Hymes ( 1 964)* a rgues that knowledge of a language implies more than an 
innate and subconscious knowledge of the rules of the language (Chomsky, 1965). 
He suggests that language use within a speech community consists of culturally 
influenced communication modes, which Include systematic patterning of speech 
governed by social rules. He proposes that an ethnography of speaking is 
^ required to describe 'the patterns of language use in terms of their distribu- 

tion and f unct i^on . He categorizes language In t,erms of basic functions: 
expressive, directive, and referential. 

Hal H day (1973) categorizes language functions as instrumental, regula- - 
.Cory, interactional, heuristic, personal, Imaginative and representational. 
The instrumental function, according to Ha 1 1 i day , serves to manipulate the 
environment, to cause certain events to happen, such as "don't touch the stove!" 

< 
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etc. The regulatory function serves in controlling events through the use of 
approval, disapproval, etc. Thet>epre3fcfttatfona4- f-vmcAion^cefers to the use 
of language to make statements, convey facts and knowledge, such as to explain, 
or to report, etc. The interactional function serves to ensure social main- 
tenance. This is exhibited i.n knowledge of slang, jargon, jokes, politeness, 
and formality expectations. THe personal function allows a speaker to express 
feelings .and emotions. The heuristic function i nvol ves ' 1 anguage used to 
acquire knowledge and to Learn about the environment. Heuristic functions are 
often conveyed un the form of questions that will lead to answers. Children 
make good use of the heuristic functions in their use of why questions. The 
imaginative functions serve to creat imaginary systems of ideas, such as 
teeing fairy tales, writing novels, creating poetry, etc. 

Tough 097*0 considers two basic functions of language: relational and 
Ideational. Tfie first one is used to ''maintain the self 11 and the latter one 
Is used to direct one's self to others 1 actions. 

As a result of ethnograph i c/socio 1 ingu i It i c observations of young child^ 
ran's commun i ca t i ve interactions, Wilkinspn (1975) developed a list of language 

functions specifically related to them. Because of their importance in under- 

i 

standing the language use by school children, the functions are listed below. 

Functions of Language , 

» 

* " ' 
Who am I? 1 Establishing and maintaining self 

2 Language for analyzing self 

3 Language for exor^aamg 9eif 

Cor celebrating or despairing, etc.) 

rfho are you 7 d t3tabli3hinq'?and itamtaming relatione 

, 5 . Xo-oper a ting : 

6 £.itDa thiz ing , , understanding the other 

7 Role playing, •nimicry 

8 Guiding, directing tne other 
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. Wo/Whet ia 9 Giving informetion , ' 

^e/sheyit? 10 Recalling events (past) 

/ U Oeacribing presentments 

/ . v 12 Predicting futuca events - 

» * statements of intention 
I statements of hypothesis 

K ; I whet miqht heppen 

> \ i3 Analyzing, classifying 

14 Explaining, giving reason Vor 

15 Exploring, taking questions, but tn other 
ways also, by "sounding. out" people 

16 Reflecting on own/others' thoughts, and 
feelings , • } 

• . " (Wilkinson, 1975, pp.. 56-57)- % ' 



'. • ' * ' j • '■ 

!o her sturdy of teacher/children's language interact ions, ""Fillmore (1979) 
suggests several functions of language related to children's production and 
comprehension.. Samples of functions which she recognizes as important durirtg 
classroom interactions are: to provide and elicit information; to explain, 
to describe, t>Q clarify, etc. 

I « * ■ * 

In addition' to research'On language functions, psychol ingui St ic research 
by Cummins was felt to be important to the study of children's language use-in 
school. Cummins (1980) suggests that there are two independent dimensions of 
-4^oguage-^^f4^+encTi — c o gn i t i ve - acadm n \c 1 anguage s l^tttsv^wtTfcfr are Tefa ted 
to Hteracy skill.s, and soc i ol ingu i st ic language skflls, which a/e related to 
i n teroersonal communication skills. 

* * J* ■ ' 

Fillmore's (1976) researcfi on the acquisition of English skills of 

five early elementary school children indicates that ooth asoects of language x 

proficiency suggested by Cymmins have unique but interrelated characteristics, 

% 

Both are essential for successful achievement and social interaction in "the 
£lassroom, Fillmore notes that sociol inguist ic aspects of language are 
cructal to the acquisition and development of a second language in early 
elementary schobl ch'ildrej whi 1 e cogn i c i ve-rel a ted functions often become 



more critical for older second-language learners because of the emphasis on 
academic performance at higher grade levels. The implication of FiHmore's 
work is that both sociol ingui stic and cdgn t t i ve-academi c ' language aspects are 
important to meaningful and appropriate communication of second language 
learners/ 

More recent Research on language use in the classroom suggests that 
there are two dichotomous language dimensions. One is more rel ated .to. the 
servjice of cognition — academic-related 1 anguage f unct i ons — and the other 
is related to the service of interpersonal social Interactions — socio- 
affejfrtive related language functions (Genesee, in press). Successful communf- 
cation with other participants seems to be correlated to the degree to which 

y it 

the individual has mastered both d imensions of language use. 

The insights gained from the review of literature together wi th our 
experience as educators of language minority students provided the basis for 
developing a framework for* training teachers in language prof ic iency 'assessmen t 
issues ut i 1 izi ng ethnographid/soc iol f ngui s t ic methodolog ies . 

: : , . ■• . •« j 

IMPLEMENTATION OF THE ALPBP TEACHER TRAINING PROGRAM: PROCESS AND OUTCOMES ' 

Phase I: Bilingual Language Proficiency Assessment: An Ethnographic Approach . 

0, 4 

Phase J of the ALP8P teacher training program j#a$ implemented in the spring 
of 198O by Dr. Susan Philips through an agreement witfv the University 
of Arizona School of Education Bilingual Program and the College of Liberal 
Arts Anthropology Department to Co-sponsor a three credit (*+5 hr.) graduate 
course. Tfre course was developed to meet the needs of part i cipat/ng teachers. 



I,t focused on three aspects of language proficiency as they, relate to language 
t ^ . : « 

minority students: , ... 

- - . ' -• . ■ • 

o„ Models of Language Proficiency; 

*o Language Proficiency In'the Bilingual Classroom; ,and 
o , Language Proficiency io the Bilingual Community. 

♦ 

Through the course teachers w^re provided with background" in approaches 

x \ \ c , - . * - - 

to the assessment of fanguage proficiency of language minority students* They 

> ' r 

were introduced to basic socidl ingui'stic^and ethnographic concepts related to 

» * 

language* assessment, and were guided in the exploration of the nature of 
children's language 'prof i ci ency in both classroom and community contents. 
Sources of infopnat ion included lectures, readings, and discussions. A more , 
detailed description of th-i s 'aspect of the training component is found in , 

V » 

Phi 1 ips 1 .p£per, n An Ethnographic Approach to Language Proficiency Asaessmen t n 
(in press) . t J ^ 

Phase II: Development of a Student Observation Instrument to Determine the 4 

.Cogimunicati ve Proficiency of Language Minority Students . The theoretical and 

methodological Issues introduced by Philips formed the basis for developments 

of Phase II, which'took the form of a three*-week intensive worksh9p. The goal 

of the workshop was to provide the participants with practical ethnographic/ 

sociol inguist ic field techniques which would enabla them to participate in the 
< > ' 4 

development of a teacher observation instrument, With the instructors 1 guidance 
— Carmen Simich", a soc'iol i ngui s t , and Robert Carrasco, an ethnographer — 
participants developed the TPS . 1 • 



^"^The^orkshop' included a review of the Basic copfcepts of ethnographic 

, 4 monitoring in classroom settings. Videotapes of interactions between 

teacher/student(s) and student (s)/s tudent (s) in elementary bilingual class- 

rooms were used to aid in the development , of teachers 1 observation skills. 

The process was one of guided discovery where, "through discussion and brain- 

storming^ teachers were made aware of the wide range of communicative skills'* 

students use with different partjci pants* i n various classroom situations. 

The videotapes provided a means for detailed discussion of teacher/student (s) 

$ 

interactions vs. student<s)/student (*s) V nteract f ons which focused on: 

, ' 1 
o^ language use, language choice, code-switching and their 
7 relationship* to communicative proficiency; 

o students' linguistic repeVtoires; and 

o sociol ingui st ic rules of interaction in the classroom. 

V 

* The discussions resulting, from viewing the videotapes were related to the^- 

. teachers 1 practical experience as ethnographers and participant observers*. - ' 

q< • 

t\ 

After viewing the tapes, the participants and workshop leaders agreed that 

teachers were the most qualified to make' valid emic predictions about* their own 

'students' communicative abilities. Outside observers , it was concurred, would not 

generally be aware of the specific rules «of interaction implicitly or explicitly 

a 

agreed upon by participants in classroom settings. 

Early in the workshop,, teachers were asked to list students' behaviors 
that, in their opinibn, correlated with Ehglish proficiency- The purpose of 
' the activity was to identify participants 1 understanding of communicative 
- prof iciency. .Responses from this informal survey, summarized irt Table 1, w$re 
analyzed, and grouped into four categories of behaviors. TheSe are: 

4 - i' 

erIc . * ii I? ^ 



o Pt linguistic behaviors related to grammatical, morphological, 
, 'and syntactic skills 4n oral speech,* as well as literacy 
ski 1 1 s ; 

' > * * 

o ethnographic/sociol inguistic ^behaviors related to language* 
use considering setting, participants, nonverbal behaviors, 
goafs of- interact ion , languagets) used by students; 

o ' student background factors related to language of the home, 
language(s) exposure, years of "school i.ng, etc.; and 

o- psychological factors related to sel f-concept -and lahguage(s) 
used in emotional interactions. " 

Sixty-five percent of the total number of behaviors identified were linguistic, 
seventeen percent fell within the ethnographic/sociol inguistic category, 
twelve percent were student background factors and six percent were psycho- 
logical factors., - The~most frequently cited linguistic behaviors focused, on 
ability to explain, amount of code-switching touring discourse, contribution 
to discussion a^id initiating conversation. Word order, command of syntax, 
and vocabulary as well as the ability* to complete writing assignments were 
cited, as major indicators of "good" writing ability. Listening factors se- 
lected were "good" receptive ability and understanding verbal cues. Only one 
reading skill, the ability to read at grade level, was named. 

Among the most ofteh ^Ssted ethnographic/sociol inguistic behaviors were: 

* **■ ' 

the languagets) students use during 'play situations, the use of nonverbal 

behaviors, "language fluency, 11 and ability to initiate conversation with 

* 

different pa rt.i c i pants in distinct contextual settings. Background informa- 

■0 * 

tion factors cited were: language of the home, number of years of schooling, 
information in students 1 cumulative files, and ethnic background. Language use 

— »v 

in the home was the one most often mentioned. The psychological factors 
designated were: studertts' shyness or sel f -cortsc iousness, and language(s) 



x 



TA8LE 1 

Teacher Selected decors Usaa :o Evaluate 
Students' Communicative 3 roficiencv 



-Inguisctc Senaviors 



Number Times 
Sel*$£*ed 



°ercentage 



Codt-swi ccning (Uswia rwo lanauaoes during discourse) 

Use of dfalecc(s) 

"Good" Pronunciation 
' lesooncsing '\*tM M :o directions, Questions, etc. 
, Inftiacing conversation 

Contributing to oiscussion 

Abhlity to exolain In a grouo sicuacion * 
(e.^. . "gooo" productive ability, amount of calk, 
joility to ntgotiate) 

4 c i C i no 

■■ "■" ■ • 
Word order, noun and verb agreement, placement of adjective 

before noun _ 
"Satisfactorily" ccmoleting writing assignments in English 
Co«oleting tasks > ndependent ly and accurately, "witti 'good 1 

control of syntax and vocaoulary" 
3uitding on sentences 

Li Kenind 

"Good" receotive joility 
Understanding veroal cues 



^eadino 



heading on grade level 



5 
l 
I 
I 

2 
U 

15 



TOTAL NUMBER OF TIMES SELECTED 



I 

so 



Stnnograohi c/Sociol ingui stic 3enaviors 



Language (s) used witn peers during unsuoerviscd play situations 

Language(s) used t with peers and teacher during supervised situations - 

Ability :o initiate conversation witn teacher and seers in classroom 
■ n soth small ana Urge instructions! groups 

Use of Jingles during unsupervised activities in :he playground 

Language f ! uency 

Monveroai benaviors \e. ^..'Vesoonos bv nodding, blank look. **ead como") 

TOTAL 'IUM8ER OF r 'M£S SSIEC7S0 



2 
I 

3 



Students' 3acxground ; actors 



«anguageis) soo*en at home 

Language used ->ost freauently iy student at home 
I.-rorration n students' summulacive .'ile 
Munoer of /ears of scnoolmg 
Ironic baexgrouno 

TOTAL NUMBER OF TI*£S SELECTED. 



3 svenologieal ^actors 

* 



Student is 'shy or jelf conscious" 
Languageis) jsed in emotional interactions 

♦ TOTAL 'JUM6E.1 OF TIMES SELECTED 



*o:il 'iumoer of "actors 



13 



used durrng emotional interadtions: In short, results from the survey indi- 

w * " * 

cated that:, 



o teachers' criteria for judging ' language proficiency is 
generally based on <a consideration of linguistic factors 
with a particular emphasis on oral language skills; - 

jo few teacfiers include nonverbal language in their criteria, 
( of communicative performance; and 

„ o few teachers consider, in their criteria, students 1 

appropriate use of language in terms of contextual" and X 
psychological factors affect ing ; communication . 
•t » • , 

The communicative proficiency mo^el adapted from Briere (-1979, see Figure 1) 
was discussed with teachers, and related to results from the teacher survey. 
The purpose in utilizing th"i s model was to make participants aware that 
language use requires speakers/listeners to possess more than the knowledge 
of the gframmar of a language and that„ sociol ingui stic aspects of language 
should be taken into account when assessing communicative proficiency". After 
relating the model to the results of 'the survey, participants arrivedjat the ' 
conclusion that there was a 'need to consider the communicative proficiency of 
their students' in terms of both linguistic and sociol i ngu i st ic skills.. 

The review of basic ethnographic concepts, discussion of the results from 
the teachers' survey of communicative proficiency factors, and a modified 
sociol inguistic model of communicative proficiency (8riere, 1979) provided 
the foundation for the inductive process used to develop the TPS . 

< 

The major questions raised during its conceptualization and development 



were: 



o What kinds of functional language skills does the 
language minority student bring to school? 

o In which language(s), social^ contexts, and for what 
purposes does the' student communicate best? 



o* « In which language (s) does the student have the wides^ 
r contextual range of communicative abilities? * \ 

- o What kinds of communicative skills does the student 
need to master" in order to participate appropriately 
^as a member 9f the school speech community? — 

important "in the process of developing the TOS^ was the selection of 
contextual settings in which to observe students' communicative interact ions^ 
the language(s) of Instruction, directness or* indirectness of. "teacher talk, 11 
and classroom organization (teacher-cantered vs. student-centered). The* 
language characteristics and lingui'stic background of the student were also 
considered consequential for the planning of the TPS . Ethnographic,' socio- % 
linguistic and educational variables considered significant were: background 
of parents,* number of siblings at home, age, language use at home and in the 
community, ethnohistorical and ethnol inguis tic information. 

The recogni tion that students have varied re'per toi res of functional 
language use in d i f ferent £ i tuations and with different participants, motivated 

the selection of some components of speech events, suggested by Hymes (J 972-)* as the 

* * * * 

the basis for developing the TPS ♦ Table 2 describes those components used 

during the initial stage of de^je 1-opment* . They were:, setting, participants, « , 

channel of communication, languages u-sed and di scodrse *eharacterist ics. 

TABLE 2 • 1 . 

COMPONENTS OF INSTRUCTIONAL EVENTS TD BE CONSIDERED 
* " > 

IN THE DEVELOPMENT OF THE TEACHER OBSERVATION SYSTEM 



_ t . , - Channels Language(s.) 0 | 5Course Characteristics 

-Setting < Participants - of Comfrt bnl cation Used 

*• <• — i ■' 

Instruction*! 4 Teache r/S tud en t (s ) speaking ^ English coherence 

(formal) ' Student/S tuden t (s) * HstenJng " Spanish complexity 

reading ) • . adequacy of. vocabulary 

• « , , wr I tlna > * code-swl tchlng * 

Non-Instructional wn.cing 

(Informal) events • 



Ideally, an ethnographic approach to language proficiency assessment 
consists of observing a student in the community, home and sphool contexts. 
However, because of the impracticabili ty of doing so in all three domains. 



it was decided to obtain community and home information .through student 

interviews and other available school records,, ancj to only observe students 

• • ■ * 
in the school setting. • 4 

\ : . \ 

The advantages and di sadyantages .of using the categories of K setti-ng, 
participant U) , soc lol f ngy i s t ic behaviors, etc., was a critical* i ssue of 

discussion in the^ development of the TPS . After considering the range of 

* * 

.speech events that usually occqj- in a school day, thfee representative 
* 

-situations ind social contexts were chosen. In order to assist observers in 

i the description of stugenjs 1 communicative behavior in the different inter- 

* ' v > * 

actional contexts, basic questions were developed. The questions provide a 

guide to the obseryer in describing a student's range of communicative skills. 

# . 4* " « 

The questions* and interactions are described in Table 3« " » 



/ 



TAIU ) 

• . "* 

t 0 i 

OtlCRVATlOX QUtJT^OHS IN SOCIAL COMTEXTS 



ERIC 



>r So< I « I Co*t«*tS! 



ii%tt 0tr«ctt4 
Jnt t ruct low* I 



*t«f Croup 

'"1tfU«t I on* I 



Won -I n» t r hc t low* I 



4»«'tTont to k« 




What l«nfu«f«(i) «nd/or *onv«rb«l fc«h*vlgr «r# ui«4 by th« ifu4«M 


*n5*«rt4 during 




to COm«<j^l < #t«? 

W^to tht chlltf Jo«i riot <o«*unlc«t« vcrfe«l|y 4 whit «vltf«nc«.4o you 






1 




1*« that In4l<«t«* u* Jtri t »n* In* 7 0«icrlk* th« »th«vlor okl*rv«d. 


' s ' 


1. 


Whtji ch« stud«»t <Jo«s *»ot lt*« to und*nt**J, what Woti ih«/h« do 
to clarify th« ilt w »tlorW 0«icrlb« th« co«*un 1 c« t J v« b*h*vl 0 r 




J. 


0«*» th« itud«nt foUow th« l«»|l<lt «*4 «»#Hclt 'ultt of comunh 
c*tlo« Of tht 10cl«l cont«*t yow *f 0^1«rvlno' 



y 



16 



v 



« o 



i 



[ 



The field test version of the T.OS (Appendix A) has three components: 
Section I: Background Information* 

Section Mj Teacher O bserva tion Data Sh eet 



Section III: Description of Observation Data 
Seetion^f consists of a three part questionnaire: student in/ormat ion , optimal 
student information, and teacher information. The first part includes question s, 
regarding basic information about a student's name, age, sex, bi rthdate, and 
language usage- The second part corftains questions about previous schooling 
experiences and language(s) used in the home. The third part includes questions 
about the teacher's language background. Section II includes four social 
contexts used to describe students 1 communicative behavior. Three basic, 
questions guide the observer to focus on specific communi catt ve-' behav lor . 
Section III consists of two parts. In part one, N tfc^teacher summarizes ,the 
observed student's communicative behavior, 'in par^fwo, extral inguis tic factors 
that may affect students 1 communicative ability (e.g., physical, emotional, 
and/or social) are described. 

A preliminary Usage^Otenua 1 for use with the TOS was also developed. It 

4* 

consists of four sections, 

o ( I ntroduct ion 

f ^ o Rationale: description of^he ethnographic/sociol inguistfc 
m theoriesarul methodologies underlying the develop- 

me njt^rT^he T0£ 

o How doV use the TOS 

o Glossarjy of terms 



V 



The TOS Usage, Manua 1 has /lot been revised since it was originally developed 
during the second ALPBP teacher train i ng workshop. " 
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The introduction. summarizes the purpose of the TPS . The rationale ' 
provides the theoretical and methodological approaches which serve as a 
framework f^pr' an in t-e-rpre tart* iorr of students 1 commurr restive- prof xcrency . 
The ttfiird section describes how to use the TOS . The glossary of terms defines . 
terminology used in the TOS/and In the TOS Usage Manual . 

Phase IIU Toward a Validation of the TOS , It. was recognized that before the 

TOS could be validated and be of practical use to teachers, it was necessary 
to determine whether: 

tfrte selected TOS i nteract ional contexts sample valid 
presentations of students 1 'cl assroom interactions; 

o the three quest ions for -each interactional context - 
solicit from the observer an' accurate description of 
* the observed students' functional language abilities; 

o behaviors described -by teachers focus on a description 
of functional language use; 

o it is possible to identify students 1 functional t # 

abilities through observation of selected classroom, 
events ; - and 

o it is possible to develop a representative number 
'of communicative performance indicators based on 
identification of functional language abilities. 1 

I.n order to clarify these issues and in preparation for field testing of 
the TOS , participants were further .tra ined in the use of microethnographic/ 
sociol inguist ic field methods to identify 'how children use language for 
functional purposes. The workshop was organized by Charlene Rivera and Carmen 
Simich. It was expected that participants would gain a better understanding 
of what students need to know in order to accomplish communicative tasks 
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during classroom interactions, with the goal of relating this understanding 

to the observation tasks oqtl ined in the TOS . The workshop was organ i ze d as 

fol lows : , • 

o a reviev* of basic concepts of 1 anguage'*prof iciency and ^ 
language proficiency assessment; 

o a review of the anthropological orientation of "doing lf 
* ethnography 11 in classroom- settings; 

o a revie'to of the nature and intent of the TOS ; and 

o # a formal introduction to functional uses of language 
in the school, home, and community settings and their 
relationship to the teacher observation tasks outlined 
in the TOS . 

The field testing of the TPS. was incorporated into the two-day session. 
Teachers were paired ahd assigned to different schools to observe students 
from kindergarten to ninth gr^de in chosen instructional events. Each t'eacher 
recorded h I s/her observat ions individually. The half day observat ions were 
to be recorded in terms of functional language^used by the observed students 
and other participants, e.g., teacher, peers, etc. Two teachers were assigned 
to observe the same student in order to compare observations and increase 
observer reliability. Following the observations, i ns true-tors* and participants 
discussed the problems and rewards of the experience. Based on their insights 
into the process , m sma 1 1 groups reviewed the experience, bra instormed , and 
discussed possible "indicators" Of communicative proficiency'. Participants 
also grade recornmendat ions* For changes in T^ content and format. 

Efforts in the Development and Validation of the TOS . Inflate May, 1981, 
a meeting was held between ALP8P project personnel and a representative from 
Tucson UoJfled School District: The purpose of the meeting was to develop 
criteria vor analyzing the TOS field test data. The criteria agreed upon was: 
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o whether the observer answered the three questions for 
each of the four'social contexts posed in the TOS (see 
Table 3); _ _ . . \ . . 

o whether the observer provided a cpmplete and accurate 
description ofvthe social contexts observed; 

o whether the observer described a student 1 s behavior 
in terms of ~f unct i ona 1 language- use^ and 

o whether the observer's summary .of the observation 

recommendations for student placement were represen- 
tative of their description of -the student's functional 
1 language abilities. • * 

Secause the TOS was at the field test stage, the ALP8P staff were con- 
cerned that TUSO would attempt to identify "indicators" of communicative 
proficiency based only on the field test. However, after reviewing the field 
test results, the concensus of t*be ALPBP staff and the TUSO representative 
was that, at most, the data could provide a sample list of communicative 
functions related to .language praficiency identified at the time of the field 
test. Most importantly, it was concurred that the data could not compensate 
for an ethnographic/sociolingui stic study of natural language >ise in'elemen- 
tary classrooms to investigate what "ways of speaking 11 (Hymes, 1972, 1974) 
or functional uses of language that are available to participants in school 
settings. Based, on identification of reliable and valid indicators, it would 
then be possible to determine what socio 1 ingui st i c skills students^need in 
order to be considered proficient commun i cators . Once reliable and^valid 
indicators are" identified, it would 'then be possible to formally validate the 
TOS or any other similar instrument. 
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Conclusion 

■ ; 

In this concluding section, the limitations aqd significance of the ALPBP 
teacher training program in Tucson are described. The fwrpose is to provide 
evaluative information regarding the ethnographic/sociol inguistic approach to 
language proficiency assessment.*** * ^ 

Limitations of an Ethnographic/Spciol irrguistic Approach to Language Proficiency] 

Assessment. The limitations of the approach were found, to he related to its 

"f| impl ementatian in actual classroom situations rather than to its corfceptual 

framework (Philips, in press). The most significant (JetermTnants of successful 

implementation in Tucson were found* to be: 

o the working relationship between teachers and administrators; - 

1, , o the time required to become familiar with the ethnographic/ 

f- . sociol inguifetic»prientation to language proficiency 



1 



assessment; ■ 



| o the educational background of teachers; and 

1 - < ' ' ' 

1 o , the characteristics pf the ethnographi c/soc iol i ngui s t i c 

% approach. 



V . 

The Workingj Relationship Among TUSD Educators . Cooperation of educators 
^ to participate in any training program is highly related to the working rela- 
\ tionship between teachers and administrators. In the. case of TUSD, some 

tension was evidenced bet-ween teachers and administrators because of inadequate 
^communication between the two. On the one hand, teachers sometimes felt 
Vlmpotent and frustrated because they were not always suff jjcieyitly informed 

Ubout the administrative ''details which affected them. On the other hand, 

S ' ■ I . j * 

lit, was evident that internal school district changes and pressures>/ere 

reflected in the administrators' relationship with the teachers, and for this 

V ' * * 

reason, administrative details werfe not always communicated to teachers.- 

tv \ - 
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Despite this tensiqn, the gradual involvement and acceptance of the fdeas 
presented during the ALPBP train irrg sessiorts became a motivating force for 
both teacheYs- Snd administrators to cooperate fully. 

The Time Factor . Time to assimilate basic theoretical concepts and to 
become experienced in their application was found to be a problematic aspect 
in the training of the Tucson ( teachers;. The time alloted'for training wa x s 
negoti*ated*-by ALPBP "staff wj th the TUSD liaisons and was limited primarily 
by district constraints. 

Although each of the three phases of->the training program was carefully 
planned, difficulties arose In coordinating sufficient leave time for .teachers 
to attend extended training sessions. Short intermittent sessions were not 
generally possible because the major consultants were not in the Tucson area. 
The participating teachers found that the short Intense training sessions did 
not always allow sufficient time to absorb and understand the new theoretical 
concepts being introduced. One teacher summarized the feeling by indicating 

0 

that the n time Cwas) too rushed.' 1 She fel.t "overwhelmed with informat io», ,r 
Other teachers suggested that more time should have been given for additional 
practice and demonstration of observat lona I* techniques. ideally, participants 
concurred, training sessions should be distributed throughout the school 
year to all6w for clarification of theoretical concepts and their application 
in the cl assroom. 

Teacher Educational Background . Teachers, do not generally have a back- 
ground in child language development or second language acquisition issues. 

0 

They are, not familiar with communicative patterns of interaction ,of multicultural/ 
multilingual student populations; nor are they familiar with the rationale 



for assessing" language proficiency. In Tucson 1 , it was found thgt teachers 
highly correlate English language proficiency with knowledge of discrete 
grammatical/phonological items. *The participant survey (Table l) confirmed 
tfjat *bi 1 ingual educators, were not consciously aware of how soc iocul turaj 
variables Influence the manner In which morphological', phonological and 
lexical items are integrated into cohesive discourse. Teachers 1 concerns 
regarding the assessment of students 1 language proficiency were, in general, 
focuse^ on ease of* test administration and interpretation of test result's^ 
rather than with the nature and scope of children's language and its 
valid measurement- A gene ra 1 j-gco mmenda t i on from the instructors who worked 
with the teachers was that courses in linguistics, including child language 
development, second language acquisition, and language proficiency assessment, 
be integrated into undergraduate programs so that the new generation of 
teachers' is prepared to deal with the complexities of assessing the language 
proficiency of language minority students. 

Characteristics of the Ethnographic/SociQltnguistic Approach - The ^ 
approach requires systematic observation, by a participant observer, of students'j 
language use 'in naturally occurring communicative situations In different domains 
community,' home and school. The role of participant observer has two dimensions: 
that of attached, objective observer, and that of an active participant. As ^ 
such, i't requires a person to observe and, at the same time, participate in 
communicative interactions from a detached yet focused perspective. 

> 

In attempting to utilize this approach in the TOS , i t wa*s found that this 
dual role can, and generally is, problematic because it requires that the 
teacher concentrate attention on the eommun i cat i ve behaviors of one s'tudent 
while simultaneously maintaining the tfeacher role providing meaningful learning 
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activities for all students in the classroom* However, because of the nature'* 
♦of the TPS , which favors observations by participants who already have an • f 
"insiders" knowledge of social rules of language use in each individual class- 
room, it was decided to use this approach. ' 

Significance of the Ethnographic/Soc iol inguistfc Approach to Training Teachers 

* - <?, 

in Language Proficiency Assessment Issues . Despite the limitations described 

/ ' ' ' * ■ ' " 47 

above, there wer£ several # signi f icant outcomes, from the ALP8P teacher training 

'abroach tojanguage proficiency assessment. Jhe major outcomes we're: 

o teachers' awareness of the holistic nature of Janguage; 

o changesjvin teachers 1 philosophy of education, as reflected 

in their self-assessment of classroom organisation and 1 

% management practices; and x . 

o *the development of an -ethnographi'c/sbciol inguist ic 
language proficiency instrument, the TOS . 

, Teachers' Awareness of the Holistic Matur e of languaae. The holistic 
j - — , — . 

orientation to the nature of language and language proficiency assessment is 
an important aspect of th^ ethnograph ic/soc iol i ngu i sti c approach to language 
proficiency assessment. Wifhin this non-traditional approach, language 
proficiency is defined as knowledge of the grammar of a language together 
with knowledge of the rules of language use. In addition to linguistic variables, 
sociQCul tural and sociol ingui stic variables, such as setting, part icipant(s) , 
topic(s) of .interaction, language(s) used at home, school and community are 
'acknowledged. This approach is ' in contrast to the more traditional one where 
the major criterion for evaluating" 1 anguage .profic i ency is knowledge of 
specific grammatical and phonological items without consideration of the 
rules of interaction and other soc iocul tura 1 and soc iol f^u i st i c var i abl es 
that affect communication. 
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The observations of children's communicative interactions and class 
discussions provided the opportunity, for teachers to become more conscious of 
, the influence of sd<;iol inguistic factors in children's language use. Awareness 
q£ the hoi ist^Ic nature of language motjvd'ted participants to reanalyze their 
understanding of. language use and its role In classroom communication and* 
learning. .One teacher summarized, "I gained additional insight into communi- 
cation as a whole packaged' Another teacher said, "I now understand communi- 
cation is not only verbal . 11 One teacher indicated, "(j am n ow) more observant 
of ttie manner In which children communicate. . . I have learned to focus on the 
function of communicative behav iors . . . to not only listen to what'is or is not 
said but to pay more attention to. how the message is communicated. 11 

Changes In Philosophy of Education . The understanding ,and acceptance of 
the ethnographic/socicrl inguistic approach and subsequent changes in philosophy 
of education were evidenced by comments and discussions between participating 

teachers 'and instructors. Through the training, teachers became more conscious 

f 

of the need-to expose children to differerit situations in order to promote' 

» / ^ • • 

motivation and "learning througb £ variety of communicative .interact idns with 
different participants in various social contexts. ThLs "understanding 
influenced some teachers to modify their views regarding classroom organization 
and management. One teacher indicated, ri (l now) organizejphysical'ly in order 
to allow for more f^edom of interaction." Another teacher stated, n I feel an 
increased sens i t r vi ty , $o the percejpions children have of their environment, 
especially of their school environment. I feel more acutely aware of the 
various . level s of activity occurring In the classroom and school . 11 



The Development of the TPS , The development of a non-trad 1 1 iona 1 J nstru- 

merit, the TPS , was another significant outcome of the ALP8P training. The TPS 

is 'the first instrument wl^ich attempts to relate focused teacher observations 

of students 1 functional language use in 'classroom settings and commup icat ive 

prof iciency. The development of the TPS is important because it has the 

potential of providing teachers with an instrument which acknowledges the-T^ 

wide range of communicative abilities of language minority students, Al though 

' <• 

the T PS itself is not yet validated and possibly never will be, it represents" 
an important innovation In language proficiency assessment practice which has 
far reaching implications for educators servicing 1 anguage mi nor i ty students. 
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